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ABSTRACT 



Sampled-data control systems are coming of age. Many methods 
have been formulated by which both continuous and sampled-data 
control systems may be optimized. Here one method of optimum 
control design is presented using the approach of dynamic pro- 
gramming. A program to generate the state transition matrices 
from the system dynamics was developed. A program for minimizing 
rather general cost functions was written and examples are pre- 
sented utilizing the results. 
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CHAPTER I 



INTRODUCTION 



In general, any linear control system may be expressed by the fol- 
lowing state equation: 



where represents the system variables and are the control vari- 
ables. F and D are nxn and nxm matrices defining the dynamical rela- 
tionship of the states and controls. We will sample the states at dis- 
crete intervals t^ and at a sampling rate with period T. A recursive 
relationship from the solution of the above differential equation may 
be established: 



X = Fx + Du 



( 1 ) 




( 2 ) 



where 




+ • • • + 



(3) 



n . 



Equation (2) may be written: 



2£(k+l)= (|)2c(k) + A^(k) 



(A) 



where 



e 



FT 



(5) 



and 




( 6 ) 



As an example of the above equations, the open-loop system of 



Figure I-l will be considered. 







1 
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Figure I-l: Block diagram of an open loop control system. 

By inspection, the following state equation defines the example sys- 



tem: 



0 


1 




o~ 






X + 




P 


p 




_i_ 



The 4> matrix as defined by (5) has only two non-zero terms in the 
Taylor expansion for the exponential function: 



or 




( 8 ) 



(9) 



In a like manner, the convolution integral of (6) may be solved 



for A : 



A = 



r 


1 


T-t 




0 


i 


_0 


1 _ 




1 



di 



( 10 ) 



giving 



A = 



t2^ 

^2 



( 11 ) 



The system difference equation may now be written as a function 
of the sampling period T: 





1 T 






x(k+l) = 




x(k) + 


2 




0 1 




T 



u.(k) 



( 12 ) 



The calculation of the transition matrix, (|), and the external 
forcing function's impulse response matrix, A, from the matrices F and D, 



2 



of the process dynamics was accomplished with the digital computer. This 
program required an input of F and the sampling rate T. The amount of ac- 
curacy desired may be varied by the user by inputing the least significant 
figure desired. This test point for accuracy results from the fact that 
the sum of all terms in a Taylor series following the test term is less 
in magnitude than the test term. Figure 1-2 is the flow chart of the 
program. The program has been incorporated into other programs written 
and presented in this paper. 
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Figure 1-2: Flow Chart for PROGRAM PHIDEL 
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The optimal control of a system depends upon a valid determination 
of an optimal control policy which will maximize or minimize a perform- 
ance criteria. This control policy may be generated from criteria in- 
volving time, system state variables, noise, control effort, etc. In 
some cases, this control policy may be generated by active networks or 
filters incorporated within the system, or a digital computer may be 
used to generate the control. To accomplish this, all dynamics of the 
system must be fed back to the digital computer as indicated in Figure 1-3. 
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Figure 1-3: Multivariable Digital Control System 
A general approach to the optimization of any dynamic system was 
developed through the efforts of R. E. Bellman and has been called 
'^dynamic programming'*. As an example of this method, in a missile prob- 
lem, one might choose a proper cost function (terminal CEP) and minimize 
this cost throughout the trajectory. The optimum trajectory, according 
to the chosen cost function, would be computed. 

Dynamic programming appears to be an excellent method for determ- 
ining an optimal control process because of its adaptability to use on 
a digital computer. Throughout the remainder of this paper, this tech- 
nique will be utilized in formulating general programs to synthesize 
optimum controllers. 
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CHAPTER 



II ‘ 



PROGRAM OPCONI 

Again let us consider the system: 

X = F X + D u (!') 

whose discrete solution is 

2c(k+l)= (|)2i(k) + ^u(k) (4*) 

where we now take the case where u(k) is a scalar control and is 
a column vector of system impulse responses due to control inputs. 

The recursion formulas will be derived for this system minimizing the 
sum of the quadratic terms as described by the matrix Q over an N stage 
process. The Q matrix is specified by the requirements of the user and 
the application of solid engineering judgment. This cost function may 
be written: 

N T. 

J(N)= minimum Z (k)Q3^(k) (13) 

k=l 

By starting with the last stage first, equation (7) becomes: 

( rp N“ It 1 

J(N)= minimum < x"^ (N)Qx(N)+ Z x (k)Qx(k)} 

L"" — k=i — — J 

•t 

or 

J(N)= minimum ^_x"^(N)Qx(N)^ + J(N-l) (14) 

It will now be noted that only the _x"^(N)Qx(N) term contains the control 
policy u(N-l); therefore, to minimize this function over the last stage, 
we need only to find: 



6 



: ■ ■ 



8(x^(N)Qx(N) ) 
9 u(N-l) 



( 15 ) 



T 

By substitution of equation (4) into X (N)Qx(N) : 




(16) 



and 




(17) 



or 




(18) 



Equation (18) now represents the optimum control policy u(N-l). It 
will be noted that we are dividing by a multiplication of three matrices 
this 'is a valid operation because a row matrix times a square matrix 
times a column matrix will always yield a scalar number if the multi- 
plication is valid. The multiplication is valid if the dimensions of 
the respective matrices are proper; and in this case, it will always be 
valid. 

By proceeding back one more stage, the control policy u(N-2) may 
be optimized. 



J(N)= minimum )2c^(N)Qx(N)4x^(N“l)Qx(N-l) { +J(N-2) (19) 



Again by direct substitution, equation (19) becomes: 





( 20 ) 
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i • I 



Minimizing with respect to u(N-2), remembering that J(N-2) is not a 



function of u(N-2); 



and 



0: 



= 2A^Q<1,x(N-2)+2A^QAu(N-2) 



+2AT{<1, -- 4>V(N-2)Q{<() - }A 

A^QA A^QA 



4a'^04> t 

aTqa a^ha W u(»-2)=0 



A^QA 



( 21 ) 



Let 



L_ |4^(Q+Pq.)' 

L aT(Q+P^)A 



therefore 



where P = 0 
o 



3u(N-2) = A^Q(^x(N-2)+A^i|;j-Q i|;j^Ax(N-2) 



( 22 ) 



+A.^QAu(N-2)+A^iij^Q4'^Au(N-2)= 0 



or 



.•. n«-2). - 



x(N-2) 



(23) 

(24) 



Let 



P = 

1 1 1 



u(N-2)= 



A^(Q+P^)<1. 

a'^(Q+Pi)a 



x(N-2) 



(25) 



(26) 



The optimum control policy for the (N-2) stage has been found represent- 
ed by equation (26). 

To further the establishment of recursion formulas, the next stage 
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back must be considered and minimized with respect to u(N-3). The fol- 
lowing symbology will be utilized in this stage of the development: 



and 




The cost function then becomes: 



J(N) = minimum {A QA+B QB}-fJ(N-3) 

Let 4-2 = [l- L 

A^(Q+Pl)A-^ 

Therefore n r "I 

J(N)= minimum{A''^QA+ HZ' }+J(N-3) 



(27) 



(28) 



(29) 

(30) 



(31) 



Minimizing the cost function with respect to u(N-3): 



8J(N) 

3u(N-3) 



2 <j)X (N-3 ) +2^’^QAu ( N- 3 ) 



+2A'^ip/tp'^Qip ip (()x(N-3) 
- 2 1 1 2 



+2a''^i|/2%i'^Q4'i4'2Au(N-3) = 0 



(32) 



Solving for u(N-3): 

u(N-3)= 



T T T T 

A Q<^+A ip^ip0ip.ipy<p 
2 1 1 ^ x(N-3) 

A^Q MAT i|)'^ (j) i); ^ 



(33) 
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I » 
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I' 








<» 




I 




giving 



Let 



u(N-3) = - - 









x(N-3) 



P2= 



Therefore 



u(N-3) 



a'^(Q+P2) <P 
aT(Q+P2) a 



x(N-3) 



(34) 



(35) 



(36) 



It is believed that an iterative relationship may now be shown without 
regressing to another stage. The following equations may readily be 
shown to be true by an inductive proof. 



where 



or 



and 



^k+1 



. [i . Mh<Hri,) I 

aT(Q+Pj^) J' 



p = 






Pk = il), P I)j , P = 0 
k k-1 k o 



u(N-k) 



^ _ A^(Q+Pj^_]^) <l) 

aT(q+Pj^_i) a 



X (N-k) 



(37) 

(38) 

(39) 

(40) 



^(k+1) = (j)^(k)+^u(k) (41) 

To illustrate the use of the above equations, the system presented 
in Chapter I will be considered with the sampling period equal to one 



second: 




1 


1 




h 




1 


0 




<p = 






A = 




Q = 










0 


1 




1 




_o 


0_ 
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To find u(k), equations 37, 39, and 40 must be solved: 



and 



AA’^Q(j> 



0 0 
-2 -1 



and 



= 0 



u(k)= - 



a'^q<*> 

— " “2X, (k)-2x^ (k) 
A QA 



( 42 ) 



(43) 

(44) 



By substitution into equation (44) and solving for u(0), we find 
Xj^(l)=0 and X 2 (l)= -2. The following phase plane (Figure II-l) results: 




Figure II-l: Phase Plane Fbr Example Problem 

This clearly indicates that a limit cycle results and that the cost func 
tion, as determined with the use of this weighting matrix, yields a rela 
tive minimum cost of one unit. 

Using the derived recursion formulas 37, 39, 40 and 41, PROGRAM 
OPCONl was written. Figures II-2 through II-IO represent abbreviated 
flow charts of the program and the subroutines used in the program. It 
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must be remembered that the arithmetic operations represented in the 
flow charts are all matrix operations. As can be seen from Figure II-2, 
the required inputs to the program must be read from data cards. The 
following table (Table II-l) indicates the order that the data cards are 
read, the format required on these cards, and the definition of the vari- 
able concerned. The primary output of OPCONl is the value of each state 
variable, the control signal, and the cost of each stage. A complete pro- 
gram listing may be found in the appendix. 



Variable 


Definition 


Format of 
Data Card 


M 


Number of stages plus 
one 


15 


N 


Order of system 


15 


A 


Column vector of 
system impulse 
responses due to 
control inputs 


8F10.6 

(read from top of 
column to bottom) 


<i) 


State transition 
matrix 


8F10.6 

(read in order by 
columns) 


Q 


Weighting matrix of 
the cost function 


8F10.6 

(read in order by 
columns) 


2. (0) 


Initial conditions 
on the state vector 


8F10.6 

(read from top of 
column to bottom) \ 

1 

1 



Table II-l: Definition and Format of Data Cards for Program 

OPCONl. 



START 




READ: 

Q,x(0) 




PRINT: 

DATA CARDS 




Z(1,I,J)= Q(I,J) 
ZZ(I,J)= Z(1,I,J) 



C 


< 


y 


f 


C I N ^ 


>y 




< 






al 



Figure II-2: Flow Chart Of Program OPCONl 
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al 

V 





FIND: 

PSI,P,and (Q+P) 




P(I,J,K)= 

Z(I+1,J,K)= 


: PJ(J,K) 
^ RR(J,K) 
= ZZ(J,K) 


> 


' 



^ K : N ^ 

>1 f< 

GIZI) 














a2 



FIGURE II-2: (continued) 
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0.1 



If 

PRINT: 

P,i(/,and(Q+P) 



V 




SM(I,J,k)= Z(M-I,J,k) 




PRINT: 

INVERTED (Q+P) 




a3 



Figure II-2: (continued) 
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1 










a3 




STOP 



Figure II-2: (concluded) 
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Figure II-3: Flow Chart For Subroutine PROD(A,B,C,L,M,N) 
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Figure II-4- Flow Chart For Subroutine SUM(A,B,C,N) 
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Figure II-5 : Flow Chart For Subroutine TRANSQ(A, B,N) 
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Figure II-6* Flow Chart For Subroutine TRANCOL(A,B,N) 



START 




EXIT 



Figure II-7: Flow Chart For Subroutine Money (MON, E,Q,N) 
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EXIT 



Figure II-8: Flow Chart For Subroutine PPSI(B,C,D,E,F,N) 



S TART 




EXIT 



Figure II-9 : Flow Chart For Subroutine PP(A,B,C,N) 




EXIT 



Figure II-IO: Flow Chart For Subroutine FF(A,B,C,D,N) 



CHAPTER III 



PROGRAM OPCON2 

Program 0PC0N2 was written as the final phase for a versatile simu- 
lator to determine a constant gain matrix for optimization of a control 
system according to the following cost function: 

J(N)=minimum § ( 2 c^(k) Qx (k)+ru^ (k-1 ) ) (45) 

k=i 

Again u(k) is a scalar control and the Q matrix is determined in 
the same manner as outlined in the previous chapter. The variable, r, 
is a weighting cons tant , (Lagrange multiplier) determined by user needs 
and acts as a quadratic integral constraint on the control effort; such 
as a limit on energy necessary to provide the desired control. By let- 
ting r equal zero, we have the cost function of OPCONl and identical 
results are obtained from the two programs. With the use of OPCONl, no 
restraints are put on the control required by the system which may re- 
sult in the necessity of an unlimited supply of fuel to obtain the de- 
sired optimal results. 

Again let us consider the system: 

X = F X + D u (1’) 

whose discrete solution is: 

2c(k+l)= (|)2c(k)+^u(k) (4*) 

where u(k) and ^ are defined in the same manner as in the previous chapter. 

By starting with the last stage first, equation 45 becomes: 

J (N)=minimum | ^ (N)Qx(N)+ru^ (N-l)| +J (N-1) (46) 

or by substitution of equation 4’: 

J (N) =minimum |((|) 2 c(N-l)H-^u(N-l) ) Q ((() 2 c(N-l)+_Au(N-l) )+ru^ (N-1) j +J (N-1) 



( 47 ) 




■ •i.l. '■ 



We now minimize J(N) with respect to u(N-l) noting that J(N-l) is not a 
function of u(N-l). 



9 J(N) 
9u(N-l) 



0 = ^^Qct)x(N-l)+A’^Q^u(N-l)+ru(N-l) 



(48) 



or, 



u(N-i). - 

^TQA+r 



x(N-l) 



(49) 



As in Chapter II, the denominator of equation A9 will always be a scalar 
number; therefore, no matrix inversion is required. 

By proceeding back one more stage, the control policy u(N-2) may be 
optimized. Equation 45 becomes: 

J(N)=minimum xT(N)Qx(N)+x’^(N-l)Qx(N-l)+ru^(N-l) +ru2(N-2)J+J(N-2) (50) 

The following symbology will be used for clarity in this minimization: 

A 4 <}.x(N-2)+Au(N-2) (51) 

and, 



B 6= _ 



“t 

^ QA+r 



By direct substitution using 4’, 51, and 52, equation 50 becomes: 

J (N) =minimum[(<()A+ABA)'^Q((t)A+ABA)+A^QA+r (BA)^ (BA)+ru^ (N-2) j +J (N-2) 
By rearranging terms, 

J (N)=minimum|ATQA+(C (j)+AB)A)'^Q ((^4)+^B)A)+r (BA) ^+ru^ (N-2)j +J (N-2) 

We now let, 

al = B = - 






and 



<^1= <t>+Aa} 



(52) 



(53) 



(54) 



(55) 



(56) 



Equation 54 now becomes: 



J (N)=minimum|A^QA+A^t(/^QiJ;^A+r(a^A) Vru^(N-2)j +J(N-2) (57) 



I 



«•! 









I 



We now minimize J (N) with respect to u(N-2) , 



9 J (N) T T T T 

3u(N- 2) =0= A QA+A <^^Q'('iA+raiAaiA+ru(N-2) 

Solving for u(N-2) by substitution of 51 into equation 58, 

u(N-2)= - j AVA'^’J'iQ’J^l+rA^a^ai^l 4» 

IT T T T T 1 ^ 

{ A QA+A 'f' iQ'f'i'^+rA ai^l A+rj 



( 58 ) 



(59) 



We now let. 



Equation 59 becomes: 



P^=i^^QiPl+Q+raia^ 



u(N-2)= - 



A^PlA+r 



x(N-2) 



As we did in the previous iteration, we let, 



a J = - A^Pl^ 



t^-o A+r 
_ r^_ 



(60) 



(61) 



(62) 



and , 

^i)2= (63) 

By proceeding back one more stage, a recursive relationship may be defined. 
We shall define the following quantity for brevity in this development: 



(|)x(N-3)+Au(N-3) 



(64) 



The cost function, 45, may be written as, 

T 



J(N)=minimuraj^'^(N)Qx(N)+x^(N-l)Qx(N-l)+x (N-2)Qx(N-2) 

+ru^ (N-l)+ru^ (N-2)+ru^ (N-3^ +J (N-3) (65) 

By substitution of 4', 55, 56, 62, 63, and 64, equation 65 becomes: 



25 









• • 






I 



Vi 




i 



II 



mi 






m- 



4 



* 







<• 




41 




J(N)=minimum | ('^2'i'lG)TQ('i'2'('lG)+r (<^2ai^G)^ (>^2ai^G) 

+ (<(^2G)^G (,J;2G)+r (a2^G)^ (as^G) 

+G^QG+ru2(N-3)j +J(N-3) (66) 

Minimizing the cost over N stages with respect to u(N-3), 

3 3(N) „ ,T,T,T , , .T,T , ,T 

8u(N-3) = 0 = A 4'2«^iQ'f'i'('2G+A >I'2Q4'2G+A qg 

+r^"^iJjTa^a^i(/2G+r^ a2a2G+ru(N-3) (67) 

Substituting 64 into equation 67 and solving for u(N-3), we find the 
optimum control policy: 



u(N-3) = 



I ^’^:(j^iJ''J'Qi(j^i(i2+A^'f'2Q’f'2‘''A^Q+’^A'^’f'2^ia|<i'2+i^A^a2a^ } <|) 

ifj A+a'^\P'^Q\I) A+A^QA+rA^i(;^a a^i(; A+rA'^a a'^A+r] — 

- ^2112 ^2 2 - 2 1 1 2- - 2 2- J 



(68) 



Combining terms, 

u(N-3)= - { ('^lQ*^l+Q+taia^)'i’2+A^Q+rA''^a2a2 } 

|^A^4'?(t('TQ<('l+Q+raiai^) t()2A+A^ QA+rA^ a2a2A+r| 



x(N-3) 



(69) 



From equation 60, equation 69 becomes: 



u(N-3)= - f A^»^2Pl’^2+AVrA^a^a^^} <\> 

{ 'P'z^ 1 <(^ 2 A+A^QA+’^A^a 2 a 2 '^ A+r } 



x(N-3) 



(70) 



We now let, 

T 

and equation 70 becomes: 

u(n-3) = - fP2^ 2L(N-3) 

A P2A+r 



Let , 



(71) 



( 72 ) 



26 



I . . dAqp 



( 73 ) 



aj= - 



a”^P A+r 



and , 



^3= <(>+A^3 



( 74 ) 



As in Chapter II, a recursive relationship may now be shown without 
proceeding back another stage and may be shown to be true by an induc- 
tive proof. Let 



and , 



where , 



T = _ 



A^Pk_iA+r 



1 T 



a = 0 



\p = (j>+Aa . {jj = 0 
k - k o 



P = ij; +Q+ra, a , P =Q 

k k k-1 k ^ k k o 



( 75 ) 



( 76 ) 



( 77 ) 



and , 



u(N-k)= a, x(N-k) 
k — 



( 78 ) 



from, 

3c(k+l)= (j)2c(k)+^u(k) ( 79 ) 

By letting r equal zero and solving the same illustrative example as 
in the previous chapter, the same results are obtained as illustrated 
below. 



and , 



and. 



[-0 --] 

A QA+r ^ 



ijj = (j)+Aa, = 

1 “ 1 



0 0 

- 2.0 - 1.0 



rp ^ 



1.0 0 

0 0 



( 80 ) 



( 81 ) 



( 82 ) 
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and therefore, 



u(k)=a^\(k)= - 2x^(k)-2x2(k) (83) 

Equation 83 indicates the same results as in Chapter II and perscribes 
the same phase plane (Figure II-l). 

Through the use of the recursion formulas 75, 76, 77, 78, and 79, 
PROGRAM 0PC0N2 was written. Figures III-l through III-5 and Figures II-3 
through II-6 represent abbreviated flow charts of the program and the sub^ 
routines used in the program. 
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Figure III-l: Flow Chart for PROGRAM 0PC0N2. 
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AT 






ALFAT(M-I,J)= AT(1,J) 




FIND: 

\p and P 



KN= KN+1 







N 

PRINT : 

AT,i{;, and P 


N 




KN= 


0 




o2 



Figure III-l: (continued) 
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Figure III-l: (continued) 
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FIND: 


u(l ,1) 
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z= u(l,l) 

L = 1 
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FIND: 

DOL 



TCOST = TCOST+DOL 
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a4 



Figure III-l: (continued) 
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Figure III-l: 
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(continued) 
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Figure III-l: (continued) 
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PRINT: 

I,Z,X, and TCOST 




Figure III-l: (continued) 
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Figure III-2: Flow Chart for SUBROUTINE ATRAN(AT,P,PHI,DEL,R,N) 




f.:- 










START 




Figure III-3: Flow Chart for SUBROUTINE PPSI(PSI,PHI,DEL,AT,N) 
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EXIT 



Figure III-4: Flow Chart for SUBROUTINE COST(DOL,Y,Q,R,Z,N) 
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aJ 0 

Figure III-5: Flow Chart for SUBROUTINE PP(P,PSI,P1 ,Q,AT,R,N) 
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AE= AC+Q 
P= AE+AD 



A 

EXIT 



Figure III-5: (concluded) 
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Figure III-l shows that the inputs to the program must be read from 
data cards. Table III-l shows the order in which these cards are read, 
the format required on each card, and the definitions of the variables 
concerned. 



Variable 


Definition 


Format of 
Data Card 


M 


Number of stages 
Plus one 


19 


N 


Order of system 


19 


IT 


Frequency of the 
desired printing 
of output 


T9 


r 


Weighting constant 
of cost function 


F10.6 




Column vector of 
system impulse 
responses due to 
control inputs 


8F10.6 

(read from top to 
bottom of column) 


<t> 


State transition 
matrix 


nFlO.6 

(read in a row at 
a time) 


Q 


Weighting matrix of 
the cost function 


nFlO.6 

(read in a row at 
a time) 


X(0) 


Initial conditions 
on the state vector 


8F10.6 

(read from top to 
bottom of column) 



Table III-l: 



Definitions and Format of Data Cards for 
PROGRAM 0PC0N2 . 



< 
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The output of PROGRAM 0PC0N2 is the value of each state variable, 
the control signal, and the total cost of all previous stages includ- 
ing the present stage. The amount of printed output may be varied by 
the use of the IT variable’s input data card. If all output is to be 
printed, then IT must be set to one by the data card. If the user 
wishes to have 1,000 stages and has a requirement of print out of 
only a sampling of these stages, IT should be set accordingly. By let- 
ting IT equal ten, only every tenth stage will be printed out. Another 

T 

valuable output is the value of a which approaches the constant gain 

K 

matrix necessary for optimal control of a continuous system. This is 

achieved by using a small sample period and many iterations thereby 

approaching the simulation of a continuous system. 0PC0N2 is limited 

for this use because the computer memory size limits the program to ap’- 

proximately 2,000 stages. If the user has no need for the outputs of 

the values of the control signals, state variables and total costs, 

then the program is unlimited in its number of stages because the value 
T 

of a may be printed out as often as desired without storing it in mem- 
K 

ory. This alteration has been made in PROGRAM 0PC0N3, and a listing 
of this program may be found in the appendix. 

The versatility of this program may be further shown in using it 
to simulate an optimum control in accordance with the cost function. 



J(N)= minimumj^C^ (N)5C(N^ 



(84) 



which we shall call the final value criterion. Using the same method 
of derivation as before, we find the following recursion formulas: 
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II 







■ mm - ^ » 



at- 












I 




I # 



I 




I 



# 



I ■• 



# • 






§ 



=(})+^a^, i(; = 0 
K K O 



( 85 ) 



and. 



T 

a 

K 



(}> T ^ 



where , 



p = p p = 

K-1 K-2 K-1 o 



and , 



u(N-K)= 



T 

L 

K“ 



(N-K) 



( 86 ) 



(87) 



( 88 ) 



To use 0PC0N2 for this cost function, we need only to set equal 
to the identity matrix, Q to the null matrix, and r equal to zero. 

As an example of this cost function, we shall again use the same 
illustrative system. We find that: 



and, 



and, 



and, 




T 




.4 



-.2 



Pj_ = <^1= 



.8 

.4 



= [-1.0 -1.5] 



(89) 



(90) 



(91) 



(92) 



therefore , 



u(0) = - Xj^(O) - 1. 5X^(0) 



(93) 
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Given initial conditions of X^(0) = 1.0 and X^CO) = 0.0, equation 
93 results in, 

u(0) = -1.0 (94) 



therefore. 



X^(l) = X^(0)+0.5u(0) = 0.5 



(95) 



and, 

X^(l) = X^(0)+u(0) = - 1.0 (96) 

From equation 89, 

u(l) - -.4X^(1) - 1. 2 X 2 ( 1 ) = 1.0 (97) 

and , 

i 

X^(2) = X^(1)+X2(1) + .5u(1) = 0.0 (98) 

and, 

X^(2) = X2(l)+u(l) = 0.0 (99) 



Figure III-6 is the phase plane resulting from the calculated 
controls and shows that the final states at N equal two are definitely 
at a minimum and the cost function equals zero. 
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With the use of 0PC0N2 and 0PC0N3, many control systems may be 
simulated. Using these two programs, a system may be designed for a 
number of optimization criteria while greatly reducing design time. 
In the next chapter, a typical system will be considered assuming 
an optimization criterion and the resulting design will be obtained. 
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CHAPTER IV 



EXAMPLE PROBLEM 

To show the use of the programs that were written and developed 
in the preceding chapters, the following example problem was chosen. 
The transfer function is typical of a servo motor, the roll attitude 
control of a missile, and many others. Figure IV-l shows the open 
loop plant to be controlled. 



u 


1 


^2 




1 




r 


S+l 


r 


s 





Figure IV-1: Block Diagram of the Open Loop Control System. 

The following state equation defines the system: 





0 1 




0 


X = 




X + 






£ ”1 




1 



With the use of PROGRAM PHIDEL and a sample period of one second. 



( 100 ) 



and A are: 





1.00 


.632 




.36F 


x(k+l) = 






x(k)+ 






_ 0.0 


.36^ 




.63^ 



( 101 ) 



To show the flexibility of PROGRAM 0PC0N2, four different cost 
functions will be considered and compared. The first cost function 
will be the terminal value function for time optimal control. (Case I) 



J(N) = minimum 2 i'^(N) 2 c(N) 



(84») 



This will then be compared to the terminal value control with 
an energy control shown by equation (102). (Case II) 
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■ 




(102) 



J(N) = minimum (N)x(N)H- ^ u^(K-l) 

k=l 

The next case of interest minimizes the sum of the squares of the 
states with an energy limitation. This is represented by equation (45*), 
(Case III) 

k=N 

J(N) = minimum x (K)Qx (K)+ru^ (K-1) (45*) 

k=l 

where, 

Q = I and r = 1.0 (103) 

The final cost function will also be that of minimizing the states 

with an energy limitation; however, by use of PROGRAM 0PC0N3, a steady 
state feedback matrix was found. These values were then used in 
PROGRAM 0PC0N2 to obtain a transient solution. (Case IV) The elements 
of this control are; 

a^(l,l) = -0.627797 (104) 

and, 

a'^(l,2) = -0.615037 (105) 

With the use of PROGRAM 0PC0N2, a transient solution was obtained 
in each of the four cases. Case II was computed for a twenty second 
trajectory in the phase plane. Figure IV-3. Cases III and IV were each 
run for ten second trajectories while Case I was optimized in two samples 
Figure IV-2 is a plot of control versus time for each of the cases. 
It is of interest to note that both cases III and IV utilize the same 

controls during the first seventy percent of their trajectories; only 

when the control is very small in the last couple of sampling points 
does the control required differ. This thereby leads to identical trajec 
tories in the phase plane indicating that constant gain amplifiers in the 
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feedback loop are just as effective as variable gain amplifiers for com- 
pensation of this plant. Case II requires nearly a constant control ef- 
fort after the initial control jump has been made. The required control 
for the twenty second trajector is approximately equal to one half of 
the necessary control for a ten second trajectory. 

Figure IV-3 is a phase plane plot of the four cases. One thing to 
note here is the trajectory of case II. As the total number of sample 
periods is increased, the necessary control is decreased as indicated 
above. This results in the trajectory approaching the axis as the 
number of sample points increases indefinitely. This means that the 
cost function used is optimized when the final value of the states is 
zero and the control is nearly zero. The point in the phase plane would 
drift in requiring only a very slight amount of control to stop it at its 
steady state value. 
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Figure IV-2: Plot of Control Versus Time for the Four Cases. 
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Figure IV-3: Phase Plane Plot of the Four Cases. 
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APPENDIX IV lV-6 PROGRAM OdcoM3 (CONCLUDED) 
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Optimum digital control synthesis. 
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